Multimodal Corpus of Multi-party Conversations in Second Language
نویسندگان
چکیده
We developed a dialogue-based tutoring system for teaching English to Japanese students and plan to transfer the current software tutoring agent into an embodied robot in the hope that the robot will enrich conversation by allowing more natural interactions in small group learning situations. To enable smooth communication between an intelligent agent and the user, the agent must have realistic models on when to take turns, when to interrupt, and how to catch the partner’s attention. For developing the realistic models applicable for computer assisted language learning systems, we also need to consider the differences between the mother tongue and second language that affect communication style. We collected a multimodal corpus of multi-party conversations in English as the second language to investigate the differences in communication styles. We describe our multimodal corpus and explore features of communication style e.g. filled pauses, and non-verbal information, such as eye-gaze, which show different characteristics between the mother tongue and second language.
منابع مشابه
Differences in Interactional Attitudes in Native and Second Languag Conversations: Quantitative Analyses of Multimodal Three-Party Corpus
Quantitative analyses and the analyses of a questionnaire were conducted to examine the relations between participants’ communicative activities and their interactional attitudes in conversations both in their native and second languages. The two categories of conversations revealed different gaze patterns that reflected the differences in difficulties they had with communication and grounding ...
متن کاملCreation of Multimodal Corpus for Modeling Turn Management in Multi-party Conversations
Spoken interactions are known for accurate timing and alignment between interlocutors: turn-taking and topic flow are managed in a manner that provides conversational fluency and smooth progress of the task. When considering applications like robot companions which interact with the user in real time, turn-taking and topic flow are also important. This paper describes creation of multi-modal co...
متن کاملA Multimodal Corpus for Studying Dominance in Small Group Conversations
We present a new multimodal corpus with dominance annotations on small group conversations. We used five-minute non-overlapping slices from a subset of meetings selected from the popular Augmented Multi-party Interaction (AMI) corpus. The total length of the annotated corpus corresponds to 10 hours of meeting data. Each meeting is observed and assessed by three annotators according to their lev...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملObservations on overlap: findings and implications for automatic processing of multi-party conversation
We examine the distribution of overlapping speech in different corpora of natural multi-party conversations, including two types of meetings, and two corpora of telephone conversations. Analyses are based on forced alignment and speech recognition using an identical recognizer across tasks. Three results are discussed. First, all corpora show high overall rates of overlap, with similar rates fo...
متن کامل